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(57) Audio/visual reproduction equipment (3) con- 
verts an identification code of the reproduction equip- 
ment into a plurality of signal sequences using a corre- 
spondence table and embeds the obtained plurality of 
signal sequences in audio/visual signals as a digital wa- 
termark. Audio/visual reproduction equipment identifi- 
cation apparatus compares correlation values of the au- 
dio/visual signals containing the digital watermark em- 
bedded therein with all signal sequences contained in a 
correspondence table. A comparison of the correlation 
values with a previously set threshold value determines 
the embedded signal sequences and thus the identifi- 
cation code of the audio/visual reproduction equipment 
which may be extracted. 
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Description 

[0001] This invention relates to reproduction equip- 
ment for audio/visual signals. In the present specifica- 
tion, the term "audio/visual" signals refers to audio or 5 
video signals or both audio and video signals (the form 
in which these coexist is immaterial). To be more spe- 
cific, the invention relates to apparatus for embedding 
an identification code, which identifies the reproduction 
equipment, as a digital watermark in audio/visual sig- 10 
nals (reproduced signals) output from reproduction 
equipment. 

[0002] This invention also relates to apparatus for 
identifying the reproduction equipment on which signals 
have been reproduced for recording, which extracts a 15 
digital watermark from reproduced audio/visual signals, 
and which identifies the reproduction equipment on 
which the audio/visual signals were reproduced (repro- 
duced signals). 

[0003] In the present Specification, "reproduction 20 
equipment" refers not just to equipment that has only 
the function of reproducing audio/visual signals from a 
recording medium (playback) but refers also to equip- 
ment having both the function of reproduction and the 
function of recording audio/visual signals in a recording 25 
medium, and to apparatus for reproducing audio/visual 
signals from broadcast signals or from signals delivered 
via cable or telephone line. 

[0004] Recently, it has become possible to record and 
reproduce audio/visual data in various forms. Audio/vis- 30 
ual data can be recorded and reproduced as ana- 
logueue signals, as in the case of VHS, or recorded and 
reproduced as digital signals, as in the case of DVD. 
[0005] Also, the audio/visual data may consist of just 
audio signals or video (moving pictures or still pictures) 35 
signals and can be recorded and reproduced as ana- 
logue signals or digital signals. 

[0006] This invention can be applied to audio/visual 
data of any signal form. 

In particular, digital contents (audio/visual data in the ao 
form of digital signals) have come to be used widely re- 
cently. 

[0007] Regardless of whether the data are recorded 
and reproduced as audio/visual signals and in analogue 
or digital form, if the data have the property of being an 45 
authored work, the copyright thereof must be protected. 
The prohibition of illegal copies is especially important. - 
[0008] Although audio/visual data in the form of ana- 
logue signals can be copied, the degradation of quality 
(sound quality or picture quality, etc.), with each gener- 50 
allon, cannot be avoided when copying is performed. It 
can thus be said that repeated copying of analogue au- 
dio/visual data cannot be performed satisfactorily. 
[0009] However, quality degradation from copying 
does not occur at all with digital content. In other words, 55 
a copy that is exactly the same as the original is easy to 
make. 

[0010] Since illegal copies of content (or content that 



originates from such content and is distributed) cannot 
be distinguished from the original, it is difficult to provide 
evidence that proves their illegality. The establishment 
of technical methods that enable effective protection of 
copyright is thus being sought. 

[0011] The use of "digital watermarks" is being exam- 
ined as such a method. 

A "digital watermark" consists of data that are embed- 
ded in audio/visual signals in a manner that is impercep- 
tible to a viewer or listener and are devised so that the 
digital watermark can be extracted from the audio/visual 
data in which it is embedded. 

[0012] Copyright information (for example, the name 
of the copyright holder, date of copyright, etc.) are em- 
bedded in audio/visual data asa watermark for protec- 
tion of the copyright. 

[0013] By extracting the embedded digital watermark 
(copyright information) from audio/visual data suspect- 
ed of having been copied illegally, the copyright owner 
of the content can be seen and the illegality of a copy is 
exposed. In such a manner, digital watermarks are in- 
tended to prevent illegal copies. 

[0014] Specific techniques for embedding a water- 
mark in audio/visual data are described in detail, for ex- 
ample in "The Fundamentals of Digital Watermarks - A 
New Protection Technology for Multimedia" by Kashio 
Matsui (Morikita Publishing, 1998), etc. 
[0015] Japanese patent publication No. 2982768 also 
discloses the prevention of illegal copying of content by 
embedding a digital watermark in audio/visuai signals. 
[0016] In the art described by this literature, an illegal 
copy prevention signal is embedded in advance as a 
digital watermark in the audio/visual signals. 
Extraction of the illegal copy prevention signal from the 
audio/visual signals is then performed during the repro- 
duction of the audio/visual signals: If the copy preven- 
tion signal has been extracted when the audio/visual 
signals are recorded, noise is added as a new digital 
watermark. 

[0017] Thus each time an illegal copy of a recording 
medium, based on the above art is viewed or listened 
to, noise is added to the audio/visual signals. This de- 
grades the quality (sound quality or visual quality) of th 
audio/visual signals each time the signal is reproduced 
or copied. Eventually, such a large amount of noise is 
added to the audio/visual signals that viewing and lis- 
tening is impossible. As a result, illegal copying in mul- 
tiple generations is inhibited. 

[0018] With the prior art, the reproduction equipment 
that was used for copying cannot be identified. This is 
because, with the prior art, the digital watermark that is 
embedded in the audio/visual signals is, for example, 
the name of the author, random nois without meaning, 
etc. The embedd d information has no relationship to 
the reproduction equipment. Even if the digital water- 
mark discloses the name of the author or copyright own- 
er, this information is of no practical use unless proof 
can be obtained of the fact that illegal copying was per- 
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formed. 

[0019] If the reproduction equipment that was used for 
copying can be identified, it can be claimed with a high 
degree of certainty that the owner or user of the repro- 
duction equipment was involved in illegal copying. How- 
ever, the prior art is incapable of providing this informa- 
tion. 

[0020] Illegal copying therefore cannot be restrained 
effectively by the prior art. The present invention seeks 
to provide apparatus which can identify the reproduction 
equipment used for copying. 

[0021] Generally, in extracting the embedded digital 
watermark in accordance with the abovementioned lit- 
erature, the values of correlation between all noise 
strings used in embedding and the signals in which the 
digital watermark is embedded are determined and the 
noise string that exhibits the greatest correlation value 
is extracted as the embedded noise string. However, if 
the embedded noise string is selected arbitrarily, there 
may be a noise string that exhibits a high correlation val- 
ue by chance. In this case, the embedded noise string 
cannot be extracted accurately. The present invention 
therefore also seeks to provide apparatus by which the 
embedded digital watermark can be extracted with high 
precision. 

[0022] In some cases, people who copy audio/visual 
signals illegally intentionally disable the extraction of the 
information embedded as a digital watermark. For ex- 
ample, the signal sequence is interchanged or a part of 
the signal is removed. When such processing is per- 
formed, the embedded digital watermark cannot be ex- 
tracted correctly by the prior art. The present invention 
seeks to provide apparatus by which a digital watermark 
can be extracted without fail even when a third party 
processes the audio/visual signals. 
[0023] In some cases, people who perform illegal cop- 
ying analyze the embedded information or embedding 
method and intentionally embed a false digital water- 
mark. With the prior art, the protection of the copyright 
is insufficient when a third party is successful in analyz- 
ing the embedded information. The present invention 
seeks to provide apparatus that contains a counter- 
measure for cases where a third party is successful in 
analyzing the digital watermark. 

[0024] According to a first aspect the present inven- 
tion audio/visuai reproduction equipment is character- 
ised in that it has a digital watermark generating means 
including means for generating a digital watermark con- 
taining attribute information that identifies the reproduc- 
tion equipment; a digital watermark embedding means 
including means for generating watermark-embedded 
audio/visual signals which embeds said digital water- 
mark in said audio/visual signals; and output means for 
outputting said watermark-embedded audio/visual sig- 
nals for reproduction. 

[0025] With the above arrangem nt, audio/visual re- 
production equipment that was used for illegal copying 
can be identified specifically by means of the digital wa- 



termark that is extracted from illegally copied audio/vis- 
ual signals. That the owner, etc. of the identified repro- 
duction equipment has been involved in illegal copying 
can thus be claimed. A system for copyright protection 
5 can thus be established to prevent illegal copying. 
[0026] According to a second aspect of this invention, 
audio/visual reproduction equipment comprising a cod- 
ed signal input unit (101) for receiving coded audio/vis- 
ual signals; a decoding unit (102) including means for 
10 reproducing said audio/visual signals from said coded 
signal input unit; an identification code generating unit 
(103) including means for generating an identification 
code by which the reproduction equipment can be iden- 
tified; a digital watermark embedding unit (104) includ- 
es jng means for embedding said identification code as a 
digital watermark in said audio/visual signals input from 
said decoding unit (102); and an output unit, which out- 
puts audio/visual signals having said digital watermark 
embedded therein by said digital watermark embedding 
20 unit (104). 

[0027] The plurality of signal sequences obtained are 
embedded as a digital watermark in the audio/visual sig- 
nals during reproduction. With a reproduction equip- 
ment identification apparatus, the values of correlation 
25 between the audio/visual signals in which the digital wa- 
termark was embedded and all of the signal sequences 
contained in the correspondence table are determined 
and compared with a previously set threshold value to 
determine the embedded signal sequences. The identi- 
30 fication code of the reproduction equipment is extracted 
using a plurality of signal sequences obtained from au- 
dio/visual signals of at least a fixed length of time T. 
[0028] With this arrangement, the identification code 
of the reproduction equipment used in the copying proc- 
35 ess can be extracted from the illegally copied audio/vis- 
ual signals to enable detection and prevention of illegal 
copying. 

[0029] In a third aspect of this invention, the signal se- 
quences with which the cross correlation values are 
40 smaller than a previously set value (threshold value of 
cross correlation) are used as the signal sequences to 
be embedded. 

[0030] With this arrangement, the precision of extrac- 
tion of the embedded signal sequences by the repro- 
45 duction equipment identification apparatus is improved 
and the precision of extraction of the identification code 
is improved. Identification of the reproduction equip r 
ment is thus enabled. 

[0031] A plurality of signal sequences may beembed- 
50 ded randomly by the reproduction equipment so that 
they will be embedded at the same proportion per fixed 
time T. 

[0032] With this arrangement, even where people that 
perform illegal copying perform the process of extracting 
55 parts of the audio/visual signals at fixed intervals, the 
identification code can be extracted without fail from the 
illegally copied audio/visual signals to enable identifica- 
tion of the reproduction equipment. 
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[0033] Preferably, the identification code is converted 
into a binary bit string. A signal sequences correspond- 
. ing to the "1 "s or the"0 ,M s of the bit string are embedded 
by the reproduction equipment. The order of the embed- 
ded signal sequences does not require a meaning. 
[0034] With this arrangement, even where people that 
perform illegal copying change the temporal sequence 
of the audio/visual signals, the identification code can 
be extracted without fail from the illegally copied audio/ 
visual signals to enable identifying of the reproduction 
equipment. 

[0035] The contents of the correspondence table that 
are held in the reproduction equipment and the repro- 
duction equipment identification apparatus may be 
changed to be always the same by means of a corre- 
spondence table changing signal. 
[0036] With this arrangement, even in the case where 
the embedded signal sequences are leaked to a third 
party, new signal sequences can be embedded by 
changing the correspondence table to enable identifying 
of the reproduction equipment. 

[0037] The present invention also comprehends a re- 
cording medium when recorded using the method of the 
invention as defined herein or the apparatus of the in- 
ventor as defined herein. In this respect a further aspect 
of the invention comprises a recording medium bearing 
signals including a digital watermark containing attribute 
information by which the reproduction equipment on 
which the audio/visual signals were produced for re- 
cording can be identified. 

[0038] The above, and other objects, features and ad- 
vantages of the present invention will become apparent 
from the following description read in conjunction with 
the accompanying drawings, in which like reference nu- 
merals designate the same elements. 

Fig. 1 is a block diagram of a reproduction equip- 
ment identifying system of an embodiment of this 
invention. 

Fig. 2 is a block diagram of the reproduction equip- 
ment of the invention. 

Fig.. 3 is a block diagram of the reproduction equip- 
ment identification apparatus of the invention. 
Fig. 4 is a flowchart for the reproduction equipment 
of the invention. 

Fig. 5 is a flowchart for the identification code gen- 
erating unit of the invention. 
Fig. 6 is an example diagram of a correspondence 
table of the identification code bit positions and sig- 
nal sequences of the invention. 
Fig. 7 is an explanatory diagram of the identification 
code bit positions of the invention. 
Fig. 8 is a flowchart for the digital watermark em- 
bedding unit of the invention. 
Fig. 9 is an explanatory diagram, which shows an 
example of embedding signal sequences in video 
signals by the inv ntion. 

Fig. 1 0 is a flowchart for the reproduction equipment 



identification apparatus of the invention. 
Fig. 11 is a flowchart for the identification code judg- 
ment unit of the invention. 

5 [0039] Referring to Fig. 1 a reproduction equipment 
identification system of the embodiment of this invention 
includes a reproduction equipment 3 having an audio/ 
visual reproduction means 31. Audio/visual reproduc- 
tion means 31 is of a type capable of reproducing audio/ 

10 visual data moving in a direction Nlfrom an original re- 
cording medium 1 . The audio/visual signals from audio/ 
visual signal reproduction means 31 are applied to a dig- 
ital watermark embedding means 33. A digital water- 
mark generating means 32 applies a digital watermark 

is to digital watermark embedding means 33. The digital 
watermark indicates attribute information by which the- 
recording equipment 3 can be specified. The method of 
generating the digital watermark may. be. any conven- 
tional method, such as that described in the book intro- 

20 duced in the section on the related arts. What is impor- 
tant is that reproduction equipment 3 can be specified 
by this attribute information. 

[0040] The resulting watermark-embedded audio/vis- 
ual signals are applied to an output means 34. Output 

25 means 34 applies the watermark-embedded audio/vis- 
ual signals to a reproduction device 6 and to an audio/ 
visual signal recording equipments. A copier 10 repro- 
duces the data on original recording medium 1 using the 
output of reproduction equipment 3. In addition, audio/ 

30 visual signal recording equipment 4 duplicates the per- 
formance of illegal copying onto a copy recording medi- 
um 2. 

[0041] Copy recording medium 2 is then available as 
physical evidence of the illegal copying performed by 
35 copier 10 (represented by a stick figure of the person 
doing the copying). 

[0042] A reproduction equipment identification appa- 
ratus 5 is used to prove the fact that copy recording me- 
dium 2 was prepared by copying using reproduction 

40 equipment 3. Reproduction equipment identification ap- 
paratus 5 includes an audio/visual signal reproduction 
means 51 which receives the copied output of copy r - 
cording medium 2. The output of audio/visual signal re- 
production means 51 is watermark-embedded audio/ 

45 visual signals which are applied to a digital watermark 
extraction means 52. Digital watermark extraction 
means 52 derives the embedded digital watermark from 
the watermark-embedded audio/visual signals, arid ap- 
plies the resulting digital watermark to a suitable repro- 

50 duction device such as, for example, a printing means 
53 for printing the digital watermark on paper. Printing 
means 53 may be any convenient human-understand- 
able device such as, for example, a computer monitor, 
TV display. In some applications, a combination of dis- 

55 play for immediate review, and a permanent printed 
record may b desired. 

[0043] It is assumed in the following that copier 10 
do s not hav a copyright for recording medium 1 and 
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that copier .10 can be identified as an owner or user of 
reproduction equipment 3. 

[0044] The form of the signal in original recording me- 
dium 1 and copy recording medium 2 is arbitrary and 
may be either analogue or digital. The form of recording 5 
medium of recording medium 1 and copy recording me- 
dium 2 is also arbitrary and may be selected freely from 
among disks, tapes, hard disks, etc. 
[0045] In general, reproduction equipment 3 may be 
of a type that is distributed in large numbers in the mar- 10 
ket while reproduction equipment identification appara- 
tus 5 is generally owned by an organization that controls 
the copyright for recording medium 1 or by the police or 
other authority that exercises control over copyright vi- 
olations. 15 
[0046] Although, for purposes of illustration, repro- 
duction equipment 3 and reproduction equipment iden- 
tification apparatus 5 are shown at the same location, 
reproduction equipment 3 and reproduction equipment 
identification apparatus 5 normally exist in separate lo- 20 
cations. Usually, these equipments also differ in their 
time of use. 

[0047] With the system of this invention, illegal copy- 
ing, by copier 10 can be proven by the process to be 
described below. 25 
[0048] With the system shown in Fig. 1 , when copier 
10 performs illegal copying, copier 10 sets original re- 
cording medium 1 in reproduction equipment 3, con- 
nects reproduction equipment 3 to audio/visual signal 
recording equipment 4 with a cable, etc., and sets copy so 
recording medium 2 in audio/visual signal recording 
equipment 4. 

[0049] Copier 10 also connects reproduction equip- 
ment 3 or audio/visual signal recording equipment 4 to 
a reproduction device 6 to monitor the audio/visual sig- 35 
nals. 

[0050] If the audio/visual signals contain both sound 
and images, reproduction device 6 may be television 
equipment. If the audio/visual signals contain only 
sound, reproduction device 6 may be an amplifier and 
speaker (or headphone), etc. 

[0051] As was mentioned above, the audio/visual sig- 
nals may be either analogue or digital signals, and a re- 
production device 6 that is compatible with the form of 
audio/visual signals used will be used. 45 
[0052] If copier 10 considers monitoring to be unnec- 
essary, reproduction device 6 may be omitted. 
[0053] Even if copier 10 monitors the audio/visual sig- 
nals using reproduction device 6; since the digital wa- 
termark data are embedded in the audio/visual data in 50 
a manner that is imperceptible to the viewer or listener 
as was mentioned above, copier 1 0 cannot normally no- 
tice that a digital watermark is being embedded in the 
monitored audio/visual signals. 

[0054] The present inv ntion does not degrade the 55 
quality of audio/visual signals by th digital watermark 
as in the prior art described in the above mentioned pat- 
ent publication. Thus if copier 10 simply monitors the 



audio/visual data recorded in recording medium 1 with- 
out performing illegal copying, the monitored audio/vis- 
ual signals will retain good quality. 
[0055] This invention thus excels over the art of the 
abovementioned patent publication in the point that 
good quality is maintained as long as only legitimate 
monitoring is performed. 

[0056] It can be readily understood that, when it is 
clear that the digital watermark extracted from copy re- 
cording medium 2 indicates attribute information unique 
to reproduction equipment 3, the suspicion that copier 
1 0, whose connection as the owner, etc. of reproduction 
equipment 3, is involved in the illegal preparation of copy 
recording medium 2 becomes provable. 
[0057] Thus with this invention, by embedding at- 
tribute information unique to reproduction equipment 3~ 
as a digital watermark in the reproduced audio/visual 
signals, the copyright of recording medium 1 can be pro- 
tected effectively. 

[0058] From the standpoint of copier 1 0, since copier 
10 cannot perceive that a digital watermark is being em- 
bedded even if he/she monitors the audio/visual signals 
on means of reproduction device 6, the evidence of ille- 
gal copying is inscribed in copy recording medium 2 
without the knowledge of copier 10. 
[0059] A copier 10 who comes to know of these cir- 
cumstances will thereafter be discouraged to perform 
illegal copying heedlessly due to his/her understanding 
of the likelihood of exposure of participation in the illegal 
deed. 

[0060] This invention can thus restrain illegal copying. 
[0061] A representative form of coded audio/visual 
signals is now taken up as an example of the audio/vis- 
ual signals recorded in recording medium 1 and a pref- 
erable embodiment for this type of audio/visual signals 
is now described in detail. 

[0062] Referring to Fig. 2, audio/visual reproduction 
equipment 3 includes audio/visual reproduction means 

31, as previously described. Audio/visual reproduction 
means 31 includes a coded signal input unit 101 which 
feeds a coded signal to a decoding unit 102. 

[0063] An identification code generating unit 103 ap- 
plies its output to digital watermark embedding unit 1 04. 
The output of digital watermark embedding unit 104 is 
applied to the input of an output unit 105. Identification 
code generating unit 103 receives a correspondence ta- 
ble changing signal whose nature and function is de- 
scribed in detail later in this specification. 
[0064] With the present example, the coded signal in- 
put unit 101 and decoding unit 102 correspond to being 
the audio/visual signal reproduction means 31 of Fig. 1. 
Also, the identification code generating unit 103 corre- 
sponds to being the digital watermark generating means 

32, digital watermark embedding unit 104 corresponds 
to being the digital watermark embedding means 33, 
and output unit 105 corresponds to being the output 
means 34. 

[0065] Referring now to Fig. 3, audio/visual signal r - 
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production means 51 contains an input unit 201 which 
feeds its output to a correlation value calculation unit 
203 in watermark extraction means 52. A signal se- 
quences recording unit 202 feeds its output to correla- 
tion value calculation unit 203. Signal sequences re- 
cording unit 202 receives a correspondence table 
changing signal, to be described later. The output of cor- 
relation value calculation unit 203 is fed to an input of a 
comparison unit 205. The output of comparison unit 205 
is applied to an input of an identification code judging 
unit 206. The output of identification code judging unit 
206 is fed to an identification code output unit 207 in 
printing means 53. 

[0066] With the present example, input unit 201 cor- 
responds to the audio/visual signal reproduction means 
51 of Fig. 1, the signal sequences recording unit 202, 
correlation value calculation unit 203, threshold value 
setting unit 204, comparison unit 205, and identification 
code judgment unit 206 and all component parts of the 
digital watermark extraction means 52, and identifica- 
tion code output unit 207 corresponds to the printing 
means 53. 

[0067] The correlation value calculation unit 203 de- 
termines correlation values S(k) defined as follows: 

S(k) = (Xi x Ni(k))(i = 1,2 I) 

where: 

X : the audio/visual signal sequences that is input 
N : all of the signal sequences in the 

correspondence table; e.g. N(k) k = 1, 2 m 

m : the number of signal sequences in the corre- 
spondence table 

[0068] The reproduction method by which an identifi- 
cation code is embedded as a digital watermark in the 
audio/visual signals is now described with reference to 
the flowchart of Fig. 4 which illustrates the process per- 
formed by the reproduction equipment of Fig. 2 in em- 
bedding the identification code as a digital watermark. 
[0069] Coded signal input unit 101 acquires coded au- 
dio/visual signals by readout from a recording medium 
(for example, a DVD, DV, HDD, etc.), receiving of a 
broadcast, or downloading from a network (for example, 
the Internet). Coded signal input unit 101 sends the cod- 
ed audio/visual signals to decoding unit 102 (step 301). 
Decoding unit 1 02 then decodes the coded audio/visual 
signals in accordance with the rules of compression, 
transmission protocol, etc. and generates base-band 
audio/visual signals (step 302). 

[0070] The process of identification of code gen rat- 
ing unit 103 (st p 303) is now described with referenc 
to the flowchart of Fig. 5, which illustrates the process 
performed by identification code generating unit 103. 
[0071] Identification code generating unit 103 pr - 
pares, as attribute information unique to the reproduc- 



tion equipment, an identification code from or by com- 
bining the equipment ID of the reproduction equipment, 
the card ID of an IC card connected to the reproduction 
equipment, the user ID of a user, the raw material ID of 
5 the audio/visual signals, the medium ID of th recording 
medium in which the audio/visual signals are stored, 
and the reproduction date and time (step 401). 
[00^2] For example, the equipment ID of the repro- 
duction equipment may be set to "152". in this example, 
the number ,, 152" is used as the identification code. 
[0073] This identification code is then converted into 
a binary bit string consisting of M 0"s and T's (step 402). 
When the equipment code "152" is converted into a bit 
string, it becomes "10011000". 

[0074] The signal sequences corresponding to the bit 
positions of the bit-converted identification code at- 
which the bit value is 1 are searched from a previously 
prepared correspondence table (step-403). 
[0075] Fig. 6 shows a correspondence table of the 
identification code bit positions and the signal sequenc- 
es. Fig. 7 shows the identification code bit positions. 
[0076] With the bit-string-converted identification 
code, "10011000", since the 4th bit, 5th bit, and 8th bit 
(reading from right to left) from the LSB take on a value 
of "1", the three signal sequences {N4, N5, N8} are 
found to correspond to the bit positions with a value of 
"1" by use of the correspondence table. Identification 
code generating unit 1 03 sends these signal sequences 
to digital watermark embedding unit 104 (step 404). 
[0077] Although the identification code was converted 
to binary form in converting the identification code into 
a bit string, the method of conversion 1o a bit string is 
not limited thereto. For example, a code table for the 
ASCII code, etc. may be used instead. 
[0078] Also, although signal sequences were pre- 
pared from bit positions of value "1" in the search for 
signal sequences from the correspondence table, the 
signal sequences may be prepared from bit positions of 
value "0" instead! 

[0079] The process of digital watermark embedding 
unit 104 (step 304) is now described with reference to 
the flowchart of Fig. 8, which shows the flow of the proc- 
ess of the digital watermark embedding unit 104. Digital 
watermark embedding unit 104 embeds the plurality of 
signal sequences input from identification code gener- 
ating unit 103 at the same proportion per fixed time T. 
This is done since the signal sequences can then be 
taken out conveniently at fixed proportions when audio/ 
visual signals of a fixed time T are taken out. 
[0080] That is, the number of times EMAX by which 
each signal sequences is embedded in a fixed time T is 
set (step 701) and the number of times of embedding of 
each signal sequences is cleared to 0 (step 702). 
[0081] On of the signal sequences is then selected 
randomly from among the signal sequences for which 
the number of times of embedding is not EMAX and the 
number of times of embedding of that signal sequences 
is incremented (step 703). 
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[0082] The selected signal sequence is then embed- 
ded as a digital watermark by a previously used method 
into a predetermined unit of the audio/visual signals in- 
put from decoding unit 102 (step 704). 
[0083] The processes from the selection of signal se- 5 
quences of step 703 are then repeated until the number 
of times of embedding equals EMAX for all signal se- 
quences. Then the next process is entered (step 705). 
[0084]. If the embedding process of step 703 to step 
705 is to be repeated further, the process is repeated 10 
from the clearing of the number of times of embedding 
of step 702, otherwise the embedding process is ended 
(step 706). 

[0085] Output unit 105 then outputs the audio/visual 
signals, in which the identification code, has been em- 15 
bedded as the . digital watermark by digital watermark 
embedding unit 104, to a monitor, speaker, recording 
equipment, network, etc. (step 305). 
[0086] Referring now to Fig. 9, an example is shown 
in which the signal sequences have been embedded in 20 
video signals. With this example, the embedded signal 
sequences are {N4, N5, N8}, the unit of the video signals 
in which one signal sequences is embedded (the above- 
mentioned predetermined unit) is one field, the fixed 
time T in which the proportions of the respective signal 25 
sequences are made the same is set to 9 fields, and 
each signal sequences is embedded 3 times within the 
9 fields. 

[0087] Although one signal sequences is embedded 
within 1 field as the predetermined unit in this example, so 
the predetermined unit may be set to 1 frame or the pre- 
determined unit may be set to several fields or several 
frames. 

[0088] Referring now to the flowchart of Fig. 10, the 
reproduction equipment identification method, by which 35 
the identification code is extracted from the audio/visual 
; signals, in which the identification code was embedded 
as the digital watermark, and the reproduction equip- 
ment identified thereby, is shown. Fig. 10 illustrates the 
process performed by the reproduction equipment iden- *o 
tification apparatus of Fig. 3. 

[0089] Input unit 201 sends the input audio/visual sig- 
nals to correlation value calculation unit 203 upon divid- 
ing the signals into the predetermined units, in each of 
which is embedded one signal sequence (step 901). 45 
Signal sequences recording unit 202 has recorded 
therein a correspondence table of identification code bit 
positions and signal sequences of the same contents as 
that used in the reproduction equipment. 
[0090] Correlation value calculation unit 203 deter- so 
mines the correlation values of all signal sequences in 
the audio/visual signals input from input unit 201 and 
determines the maximum correlation value from these 
correlation valu s (step 902). The maximum correlation 
value and the bit position corresponding to the signal 55 
s quences for which the maximum correlation value 
was extracted are then sent to comparison unit 205. 
[0091] For example, when the correspondence table 



of Fig. 6 is used, correlation value calculation unit 203 
determines the correlation values of the m signal se- 
quences {N1 , N2 Nm} in the audio/visual signals and 

determines the maximum correlation value from among 
these correlation values. If the maximum correlation val- 
ue SMAX is obtained for the correlation with the signal 
sequence {N4}, this maximum correlation value SMAX 
and" the bit position {4} that corresponds to signal se- 
quence {N4} are sent to comparison unit 205. 
[0092] Threshold value setting unit 204 then sets a 
threshold value for the correlation value of comparison 
unit 205 (step 903). Comparison unit 205 then compares 
the maximum correlation value with the threshold value 
(step 904) and, if the correlation value exceeds the 
threshold value, sends the bit position corresponding to 
the signal sequences for which this correlation value - 
was extracted to identification code judgment unit 206. 
If the maximum correlation value is less than or equal 
to the.threshold value, the bit positions are not sent. 
[0093] When a disturbance occurs due to illegal cop- 
ying, etc., a correlation value greater than the threshold 
value may not exist at all or a plurality of correlation val- 
ues greater than the threshold value may exist. In such 
a case, comparison unit 205 may be programmed to not 
compare the.threshold value and the correlation value 
but perform, as an exceptional process, the extraction 
of the bit position of a signal sequence, with a maximum 
correlation value S1 only in the case where the maxi- 
mum correlation value S1 satisfies a certain condition 
with respect to the other correlation values Sn (for ex- 
ample, the condition S1. > Sn). 

[0094] The process of identification code judgment 
unit 206 (step 905) is now described in detail with refer- 
ence to the flowchart of Fig. 11 which shows the process 
of identification code judgment unit 206. 
[0095] Identification code judgment unit 206 holds a 
plurality of bit positions that were obtained by determin- 
ing the correlation with a plurality of signal sequenc s 
obtained from audio/visual signals of a fixed time T or 
more using at least the reproduction equipment (step 
1 001). An identification code bit string is then generated 
from the plurality of bit positions (step 1002). An identi- 
fication code is generated from the bit string (step 1 003). 
[0096] The interpretation and method of bit string 
preparation and identification code generation are the 
same as those for the reproduction equipment. For ex- 
ample, if the plurality of bit positions obtained from an 
audio/visual signal of a fixed time T is {4, 5, 8}, since 
signal sequences are embedded at bit positions corre- 
sponding to the "V" s in the identification code bit string 
by the reproduction equipment; the bit string, 
"1001 1000", will be obtained. 

Also, since decimal to binary conversion is used in the 
generation of the bit string at the reproduction equip- 
ment, the identification code, "152", will be obtained 
from the bit string, "10011000". 

[0097] Identification code output part 207 then put- 
puts the identification code extracted by identification 



7 



13 



EP 1 187 478 A2 



14 



code judgment unit 206 (step 906). 
[0098] Also in accordance with a correspondence ta- 
ble changing signal, the identification code generating 
unit 103 of the reproduction equipment and the signal 
sequence recording unit 202 of the reproduction equip- 5 
ment identifying apparatus can change the contents of 
the correspondence tables held. Such a change of the 
correspondence tables can be accomplished by any 
method. Several correspondence tables may be held in 
advance in each of identification code generating unit 10 
1 03 and signal sequence recording unit 202. These cor- 
respondence tables may be interchanged, or a new cor- 
respondence table may be input from outside sources. 
[0099] The changes of the correspondence tables in 
identification code generating unit 103 and signal se- 15 
quence recording unit 202 are made simultaneously so 
as to make their contents agree. 

[0100] Thus evenforthe same identification code, dif- 
ferent signal sequences can be embedded as the digital 
watermark in the audio/visual signals at the reproduc- 20 
tion equipment. The reproduction equipment identifying 
apparatus can thus be made to extract the embedded 
identification code correctly. 

[01 01] Also, as the plurality of signal sequences used 
in the correspondence tables in the identification code 25 
generating unit 103 of the reproduction equipment and 
the signal sequence recording unit 202 of the reproduc- 
tion equipment identifying apparatus, signal sequence 
are used with which the cross correlation will be smaller 
than a previously set value (threshold value of cross cor- 30 
relation). By selecting a signal sequence in which the 
cross correlation is smaller, the precision of extraction 
of the embedded signal sequences can be improved 
and the precision of extraction of the identification code 
can be improved. Preferably, a PN code, M-sequence 35 
code, or Gold code is used. 

[0102] As has been described above, with the repro- 
duction equipment of the present embodiment, the de- 
coding of coded audio/visual signals is performed, an 
identification code is converted into a plurality of signal *o 
sequences using a correspondence table, and the plu- 
rality of signal sequences thus obtained are embedded 
as a digital watermark at the same proportion per fixed 
time T. 

[0103] Meanwhile, with the reproduction equipment 45 
identifying apparatus, the correlation values of the au- 
dio/visual signals in which the digital watermark was em- 
bedded and signal sequences contained in the corre- 
spondence table are determined and compared with a 
previously set threshold value to determine the validity so 
of the embedded signal sequences. 
[0104] The identification code of the reproduction 
equipment is then extracted from the plurality of signal 
sequences obtained from audio/visual signals of a fixed 
time Tor more. 55 
[0105] Furthermore, the correspondence tables in the 
reproduction equipment arid the reproduction equip- 
ment identification apparatus are changed simultane- 



ously to the same contents. The signal sequences to be 
embedded can thus be changed even for the same iden- 
tification code. 

Claims 

1. Audio/visual reproduction equipment character- 
ised in that it has a digital watermark generating 
means (32) including means for generating a digital 
watermark containing attribute information that 
identifies the reproduction equipment; a digital wa- 
termark embedding means (33) including means for 
generating watermark-embedded audio/visual sig- 
nals which embeds said digital watermark in said 
audio/visual signals; and output means (34) for out- ~ 
putting said watermark-embedded audio/visual sig- 
nals for reproduction. - 

2. Audio/visual reproduction equipment comprising a 
coded signal input unit (101) for receiving coded au- 
dio/visual signals; a decoding unit (102) including 
means for reproducing said audio/visual signals 
from said coded signal input unit; an identification 
code generating unit(103) including means for gen- 
erating an identification code by which the repro- 
duction equipment can be identified; a digital water- 
mark embedding unit (104) including means for em- 
bedding said identification code as a digital water- 
mark in said audio/visual signals input from said de- 
coding unit (1 02); and an output unit, which outputs 
audio/visual signals having said digital watermark 
embedded therein by said digital watermark em- 
bedding unit (104). 

3. Audio/visual reproduction equipment according to 
Claim 2, characterised in that, the said identifica- 
tion code is at least one of an equipment ID of the 
said reproduction equipment, a card ID of an IC card 
connected to the said reproduction equipment, a 
user ID of a user of the reproduction equipment, a 
raw material ID of said audio/visual signals, a m - 
dium ID of a recording medium on which said audio/ 
visual signals are stored, a reproduction date and/ 
or time, and/or an initial value of a signal sequ rice 
to be embedded as the said digital watermark. 

4. Audio/visual reproduction equipment according to 
Claim 2 or Claim 3, characterised in that an output 
of said identification code generating unit (103) in- 
cludes a plurality of signal sequences, and a table 
of correspondence of character strings and/or num- 
bers which express identification codes, and means 
for employing a correspondence table for selection 
of said signal sequ nces. 

5. Audio/visual r production quipment according to 
any of Claims 2 to 4, characterised in that it further 
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comprises means for converting said identification 
code into a binary bit string; and 

means for selecting a plurality of signal se- 
quences, which correspond to the positions of the 
converted bit string that take on a specific value. 5 

6. Audio/visual reproduction equipment according to 
any of Claims 2 to 4, characterised in that said 
plurality of signal sequences are signal sequences 
with which cross correlation values are smaller than 10 
a previously set threshold value. 

7. Audio/visual reproduction equipment according to 
any of Claims 2 to 4, characterised in that said 
digital watermark embedding unit (104) embeds a 15 
different signal sequence in each predetermined 
segment of said audio/visual signals. 

8. Audio/visual reproduction according to any of 
Claims 2 to 7, characterised in that said digital wa- 20 
termark embedding unit (1 04) embeds a plurality of 
signal sequences, to be embedded as the digital 
watermark, randomly in the same proportion per 
fixed time in said audio/visual signals. 

25 

9. Audio/visual reproduction equipment according to 
any preceding claim, characterised in that it fur- 
ther comprises means (4) for recording a copy of 
said watermark-embedded audio/visual signals 
that are output by said reproduction equipment. 30 

10. Audio/visual reproduction equipment identification 
apparatus comprising: 

an input unit (201) for inputting audio/visual sig- 35 
nals containing an identification code embed- 
ded therein as a digital watermark; a signal se- 
quences recording unit (202) including means 
for holding a correspondence table of the same 
contents as that of reproduction equipment; a *o 
correlation value calculation unit (202) includ- 
ing means for calculating correlation values of 
input audio/visual signals and all of said signal 
sequences contained in said correspondence 
table and for outputting a maximum correlation 45 
value among correlation values obtained; a 
threshold value setting unit (204) including 
means for setting a threshold value for said cor- 
relation values; a comparison unit (205) includ- 
ing means for comparing said maximum corre- so 
lation value with said threshold value, and for 
outputting one of said signal sequences for 
which said maximum correlation value exceeds 
said thr shold value; an identification code 
judgment unit (206) including means for d ter- 55 
mining an identification code in accordance 
with said signal s quences output from said 
comparison unit (205) and said correspond- 



ence table; and an identification code output 
unit (207) including means for outputting said 
identification code. 

11. Audio/visual reproduction equipment identification 
system comprising: 

audio/visual reproduction equipment (3); au- 
dio/visual reproduction equipment identifica- 
tion apparatus including means for generating 
attribute information that enables identification 
of at least one attribute of said audio/visual re- 
production equipment; means in both said au- 
dio/visual reproduction equipment and said au- 
dio/visual reproduction equipment identifica- 
tion apparatus for containing said attribute in- » 
formation; said audio/visual reproduction 
equipment including means forembedding said 
attribute information in an audio/visual signal 
as a digital watermark that enables identifica- 
tion of said reproduction equipment; and said 
reproduction equipment identification appara- 
tus including means for extracting said digital 
watermark embedded in said audio/visual sig- 
nal and for identifyingsaid reproduction equip- 
ment associated with said audio/visual signal 
based on the extracted digital watermark. 

12. A method of reproducing audio/visual signals, com- 
prising the steps of: 

generating a digital watermark, containing at- 
tribute information that enables identification of 
audio/visual reproduction equipment; embed- 
ding said digital watermark in audio/visual sig- 
nals to produce watermark-embedded audio/ 
visual signals; and outputting said watermark- 
embedded audio/visual signals. 

1 3. A method of reproducing audio/visual signals, com- 
prising; inputting coded audio/visual signals; de- 
coding said coded audio/visual signals to reproduce 
said coded audio/visual signals; generating an 
identification code; embedding a digital watermark 
containing said identification code in said input au- 
dio/visual signals; and outputting said audio/visual 
signals containing said digital watermark. 

14. A method of reproducing audio/visual signals ac- 
cording to Claim 13, characterised in that said 
identification code is at least one of an equipment 
ID of audio/visual reproduction equipment, a card 
ID of an IC card connected to said audio/visualre- 
production equipment, a user ID of a user, a raw 
material ID of said audio/visual signals, a medium 
ID of a recording medium on which said audio/visual 
signals are stored, a r production date and time, 
and/or an initial value of a signal s quence to be 
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embedded as said digital watermark. 

15. A method according to Claim 13, charact rised in 
that: the step of generating an identification code 
includ s using a plurality of signal sequences, and 5 
a table of correspondence of at least one of char- 
acter strings and numbers that express identifica- 
tion codes to select a one of said plurality of said 
signal sequences. 

10 

16. A method according to Claim 15, characterised in 
that it further comprises: 

converting said identification code into a binary 
bit string; and selecting a plurality of signal se- 15 
quences, which correspond to positions of said 
converted bit string that take on a specific val- 
ue. 

17. A method according to Claim 15, characterised in 20 
that the plurality of signal sequences are signal se- 
quences having cross correlation values that are 
smaller than a previously set threshold value. 

18. A method according to Claim 15, characterised in 25 
that the step of embedding includes embedding a 
different signal sequence in each of a predeter- 
mined section of the audio/visual signals. 

19. A method according to Claim 18, characterised in so 
that the step of embedding includes embedding 
said plurality of signal sequences randomly at the 
same proportions per fixed time in said audio/visual 
signals. 

35 

20. A recording medium, characterised in that water- 
mark-embedded audio/visual signals are recorded 
by the reproduction method of claim 12. 

21. A method of identifying audio/visual reproduction 40 
equipment, characterised in that it comprises: in- 
putting audio/visual signals containing an identifica- 
tion code embedded therein as a digital watermark; 
holding a correspondence table of the same con- 
tents as that in audio/visual reproduction equip- 45 
ment, calculating correlation values of the input au- 
dio/visual signals and all signal sequences included 

in said correspondence table and outputting a max- 
imum correlation value among said correlation val- 
ues; setting a threshold value for said correlation so 
values; comparing said maximum correlation value 
with said threshold value and outputting a one of 
said signal sequences for which said maximum cor- 
relation value xceeds said threshold value; deter- 
mining an identification code in accordance with 55 
said one of said signal sequences with contents of 
said correspondence table; and outputting said de- 
termined identification code. 
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Fig. 3 
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